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Abstract 

Background: Acute exacerbation of idiopathic pulmonary fibrosis has become an important outcome measure in 
clinical trials. This study aimed to explore the concept of suspected acute exacerbation as an outcome measure. 

Methods: Three investigators retrospectively reviewed subjects enrolled in the Sildenafil Trial of Exercise 
Performance in IPF who experienced a respiratory serious adverse event during the course of the study. Events 
were classified as definite acute exacerbation, suspected acute exacerbation, or other, according to established 
criteria. 

Results: Thirty-five events were identified. Four were classified as definite acute exacerbation, fourteen as suspected 
acute exacerbation, and seventeen as other. Definite and suspected acute exacerbations were clinically 
indistinguishable. Both were most common in the winter and spring months and were associated with a high risk 
of disease progression and short-term mortality. 

Conclusions: In this study one half of respiratory serious adverse events were attributed to definite or suspected 
acute exacerbations. Suspected acute exacerbations are clinically indistinguishable from definite acute exacerbations 
and represent clinically meaningful events. Clinical trialists should consider capturing both definite and suspected 
acute exacerbations as outcome measures. 
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Background 

Idiopathic pulmonary fibrosis (IPF) is a chronic, progres- 
sive, fibrotic lung disease with a median survival of ap- 
proximately 3 years [1]. The natural history of disease is 
unpredictable, with many patients experiencing periods 
of relative stability punctuated by episodes of acute 
worsening [2,3]. Many of these acute worsenings are of 
unknown cause despite careful clinical evaluation. Idio- 
pathic acute worsenings are called acute exacerbations 
of IPF and are associated with substantial morbidity and 
mortality [4], Because of its clinical significance, acute 
exacerbation of IPF has become a key endpoint in 
clinical trials of novel drug agents for IPF. 
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Epidemiological data suggest an annual incidence per 
patient year of acute worsening in IPF of approximately 
0.23, with acute exacerbation of IPF constituting slightly 
over half of acute worsening events [5]. However, inci- 
dence rates for acute exacerbation reported in recent 
clinical trial populations have been substantially lower 
[6-8]. The reason for this discrepancy is unknown. 

Acute exacerbation of IPF is defined by strict clinical cri- 
teria, which require an acute onset of symptoms, new 
high-resolution computed tomography (HRCT) scan find- 
ings, and no evidence of infection or other identifiable 
cause [4], Cases that are of unknown cause but do not ful- 
fill the criteria listed due to missing data have been termed 
suspected acute exacerbations [4] Suspected acute exacer- 
bations have generally been discounted in clinical studies, 
and the clinical features and behavior of this population 
are unknown. 
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In this study, we use a well-characterized cohort of pa- 
tients with IPF enrolled in the Sildenafil Trial of Exercise 
Performance in IPF (STEP-IPF) to examine the inci- 
dence and clinical characteristics of suspected acute 
exacerbations of IPF. We find that suspected acute exac- 
erbations are common in this clinical trial population 
and represent clinically important outcomes. 

Methods 

Subjects included in this study were participants in the 
Sildenafil Trial of Exercise Performance in IPF (STEP-IPF) 
trial conducted by the IPF Clinical Research Network 
(IPFnet) [9]. Briefly, patients were eligible for enrollment 
in STEP-IPF if they met consensus criteria for the diagno- 
sis of IPF [10] and had a diffusion capacity for carbon 
monoxide (DLCO) of less than 35% of the predicted value. 
Enrolled subjects were randomized to active drug (sildenafil 
20 mg three times daily) or placebo for the first 12 weeks 
of the study, then given open label sildenafil for the sec- 
ond 12 weeks (Additional file 1: Figure El). All STEP- 
IPF subjects provided informed consent for the use of 
their data in subsequent data analyses and were in- 
cluded in this analysis. 

Subjects in STEP-IPF who experienced a respiratory 
serious adverse event during the course of the study (as 
determined by the site principal investigator) were con- 
sidered acute respiratory worsenings for the purposes of 
the current study. As part of the STEP-IPF trial, possible 
acute exacerbation events were pre-specified as serious 
acute events and study sites were asked to collect de- 
tailed information about these events from the treating 
physician (not always at the study site). STEP-IPF did 
not identify definite and suspected acute exacerbation as 
specified by the IPFnet investigators in a perspective 
piece published after STEP-IPF was designed [4], so the 
original STEP-IPF adjudication results for acute exacer- 
bation were not used in this analysis. All acute respira- 
tory worsenings were reviewed independently by three 
of the authors (HC, CG, LR) and categorized as definite 
acute exacerbation suspected acute exacerbation, or 
other acute worsening [4]. Briefly, acute exacerbation 
was defined by acute onset of symptoms (<30 days in 
duration), new radiographic abnormalities (bilateral ground 
glass or consolidation on HRCT), and the absence of an 
identified infectious or alternative etiology (Additional 
file 2: Table El). Suspected acute exacerbation of IPF 
was defined as an idiopathic acute respiratory worsen- 
ing that could not be classified as a definite acute ex- 
acerbation due to missing data or criteria [4]. In cases 
considered as other acute worsenings, a cause was spe- 
cified were possible (e.g. lower respiratory tract infec- 
tion, pulmonary embolism). After individual reviews, all 
events were discussed as a group, and in cases of dis- 
agreement, a consensus result for each was determined. 



Inter-rater reliability for definite acute exacerbation and 
definite/suspected acute exacerbation was determined for 
the three reviewers by calculating single kappa statistics. 

Comparisons between cases and selected controls were 
performed using the two-sample £-test or Wilcoxon rank 
sum and results were reported as mean (standard devi- 
ation), median (25 th , 75 th ), or number (percent). Incidence 
rates per patient-year were determined for selected acute 
worsening subgroups (e.g. definite acute exacerbation, 
suspected acute exacerbation). Chi-square tests were used 
to determine the concordance of definite and suspected 
acute exacerbation with other measures of disease 
progression: change in forced vital capacity (FVC, defined 
as >10% relative decline), DLCO (defined as >15% relative 
decline), 6 minute walk distance (6MWD, defined as >30 
meter decline), University of California San Diego Short- 
ness of Breath Questionnaire (UCSD SOBQ, defined as 
>5 point increase) and St. Georges Respiratory Ques- 
tionnaire (SGRQ, defined as >5 point increase). In 
events with missing data due to death, disease progres- 
sion was considered to have occurred by the above 
variables. Survival analysis was performed using 
Kaplan-Meier survival estimates from the documented 
date of the acute worsening event. In some instances, 
definite acute exacerbation of IPF and suspected acute 
exacerbation of IPF events were combined into a single 
"acute exacerbation of IPF" group to enable statistical 
comparisons. All statistical analysis was performed 
using SAS Version 9. 

Results 

Cohort description 

One hundred and eighty subjects constituted the study co- 
hort. Thirty-five respiratory serious adverse events oc- 
curred during the course of the study; 31 of these were 
associated with hospitalization. Of these, eighteen (51%) 
were considered definite (four) or suspected (fourteen) 
acute exacerbation of IPF (Figure 1). Ten of the eleven ori- 
ginal cases of acute exacerbation of IPF in the STEP-IPF 
study adjudicated per protocol and reported in the original 
manuscript were included in this group; the eleventh case 
was reclassified as other acute worsening. All but one of 
the fourteen suspected acute exacerbation cases were so 
classified because they did not undergo HRCT and/or re- 
spiratory culture; four were missing only evaluation for in- 
fection (Additional file 2: Table E2). High resolution 
computed tomography and respiratory culture were not 
required by the study protocol and were not routinely 
performed by treating physicians. 

Inter-rater reliability for the adjudication of events as def- 
inite acute exacerbation of IPF (i.e. definite acute exacerba- 
tion versus suspected acute exacerbation, other or 
insufficient data) was good (0.72, 95% confidence interval 
0.54 to 0.90). There were eight cases that at least one of 
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Figure 1 Incidence of acute respiratory worsening by cause. The adjudicated cause of the 35 acute respiratory worsening events in the 

STEP-IPF cohort are represented. Four definite acute exacerbations (black bar) and fourteen suspected acute exacerbations (striped bar) were 

identified. Cases of other acute worsenings are listed by cause (grey bars). Abbreviations: AEX = acute exacerbation; LTR = lower respiratory tract. 
\ ' J 



three reviewers classified as definite acute exacerbation. Of 
these, three cases were unanimous (all three reviewers 
called them definite), five were classified as definite or 
suspected acute exacerbation, and one was classified as 
definite acute exacerbation, suspected acute exacerbation, 
and insufficient data available to adjudicate. The inter-rater 
reliability for definite or suspected acute exacerbation ver- 
sus other or insufficient data was fair (0.43, 95% confidence 
interval 0.26 to 0.60). 



Incidence and characteristics of acute exacerbation 

The overall incidence per patient year of acute wors- 
ening of any cause was 0.39 (CI 0.31, 0.60). The inci- 
dence of definite acute exacerbation of IPF was 0.04 
(CI 0.01, 0.12) and of suspected acute exacerbation 
was 0.16 (CI 0.09, 0.26). There was a strong seasonal 
association, with an odds ratio of 8.06 (CI 1.76, 
36.89, p = 0.007) for definite or suspected acute ex- 
acerbation of IPF occurring from December through 



Number of events 
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■ Definite Acute Exacerbation ■ Suspected Acute Exacerbation Other Acute Worsening 

Figure 2 Seasonal variation in risk of definite and suspected acute exacerbation and acute worsening. The number of acute worsening 
events (definite acute exacerbation = black; suspected acute exacerbation = striped; other acute worsening = grey) are demonstrated by calendar 
month. The number of acute exacerbation events (definite and suspected) per month normalized to the number of patients at risk were 
significantly higher from December to May than from June to November, with an odds ratio of 8.06 (95% CI 1.76, 36.89, p = 0.007). 
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May compared to June through November (Figure 2). 
This association was also true for other acute wors- 
enings. This finding was not explained by differences 
in the number of patients at risk during those 
months. 

Subjects with definite or suspected acute exacerba- 
tion of IPF reported increased dyspnea (94%) and 
cough (88%). Symptoms of infection such as fever 
and congestion were reported in the minority (31% 
and 24%, respectively). Over half of these subjects 
developed respiratory failure requiring non-invasive 
ventilation (18%) or intubation (35%). Most subjects 
received corticosteroids (81%) and antibiotic therapy 
(88%) as part of their treatment. Characteristics of 
definite and suspected acute exacerbations were iden- 
tical, but the number of cases was too small in these 
groups to allow statistical comparisons. 



Aqb, y63rs 


71 
/ I 


Oy 


Oy 


Male gender 


17 (100%) 


1 1 (85%) 


122 (81%) 


Disease 
duration, years 


2.01 


2.97 


1.86 


Body mass 
index 


28.3 


29.3 


29.0 


Ever smoker 


10 (59%) 


1 1 (85%) 


116 (77%) 


HRCT UIP 
pattern 


14 (82%) 


13 (100%) 


121 (81%) 


Biopsy proven 
disease 


7 (41%) 


5 (39%) 


75 (50%) 


6MWT 

distance, 

meters 


179.8 


208.5 


279.6 


FVC % 
predicted 


49.7 


54.7 


57.8 


FEV1/FVC ratio 


0.77 


0.77 


0.77 


DLCO % 
predicted 


21.7 


23.3 


27.1 


Pa02, mmHg 


60.3 


61.5 


69.5 


UCSD score 


57 


60 


45 


SF-36 physical 
score 


33.47 


28.21 


34.58 


SF-36 mental 
score 


50.87 


49.20 


51.71 


SGRQ total 
score 


55.64 


64.60 


51.80 


Sildenafil use ** 


8 (47%) 


5 (39%) 


76 (51%) 


PPI use 


3 (18%) 


7 (54%) 


68 (45%) 


Prednisone 
use 


7 (41%) 


2 (15%) 


28 (19%) 


* Combined definite and suspected cases. 



Subjects randomized to active therapy during the first 12 weeks of STEP-IPF. 



Predictors of acute exacerbation and acute worsening 

Subjects with definite or suspected acute exacerbation of 
IPF had worse dyspnea score (UCSD SOBQ), worse pul- 
monary physiology (FVC and DLCO), worse 6MWD, 
and worse oxygenation at baseline compared to subjects 
without acute worsening (Table 1). There was also an in- 
creased prevalence of patient reported coronary artery 
disease compared to subjects without acute worsening 
(53% vs. 25%, p = 0.02). Subjects who developed definite 
or suspected acute exacerbation of IPF had significantly 
greater baseline prednisone use (41% vs. 19%, p = 0.05) 
and a trend towards lesser baseline PPI use (18% vs. 45%, 
p = 0.09). There was no significant difference between 
groups in study arm (active sildenafil vs. placebo), age, or 
history of cigarette smoking. Subjects with other acute 
worsenings appeared similar to the acute exacerbation 
subjects, and risk factors for acute worsening of any 



n vs. No Any acute worsening vs. No 
P-value acute worsening P-value 

0.27 0.30 

0.08 0.1 1 

0.74 0.19 

0.64 0.75 

0.13 0.39 
>0.99 0.22 

0.80 0.76 

<0.001 <0.001 

0.03 0.04 

0.45 0.63 

<0.001 <0.001 

0.01 <0.001 

0.03 0.003 
0.44 0.03 

0.83 0.43 

0.28 0.01 

0.78 0.46 
0.09 0.45 
0.05 0.01 



Table 1 Demographics and baseline characteristics by acute worsening status 



Variable Acute exacerbation Other acute No acute Acute exacer 

*N = 17 worsening N = 13 worsening N = 1 50 acute worse 
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cause were similar to those identified for acute 
exacerbation. 

Prognostic significance of acute exacerbation and acute 
worsening 

Definite or suspected acute exacerbation of IPF was associ- 
ated with progression of disease as defined by categorical 
change in FVC, DLCO, 6MWD, UCSD SOBQ, and SGRQ 
(Figure 3). Findings were similar for subjects with other 
acute worsenings. There were fifteen deaths overall in the 
study cohort; eight (53%) occurred in the definite (n = 2) or 
suspected (n = 6) acute exacerbation of IPF group; six 
occurred in the other acute worsening group. Only one 
occurred in subjects without acute worsening. Overall 
24-week mortality in the definite or suspected acute ex- 
acerbation of IPF group was 47%, similar to that of subjects 
with other acute worsenings (Table 2). This was signifi- 
cantly greater that the 24- week mortality in subjects with- 
out acute worsening (1%, p < 0.01). Most deaths in the 
definite or suspected acute exacerbation of IPF and other 
acute worsening group occurred within twelve weeks of 
the acute exacerbation event (Figure 4). 

Discussion 

These results suggest that suspected acute exacerbations of 
IPF are common, clinically relevant events in patients en- 
rolled in clinical trials of IPF. The similar clinical character- 
istics, risk factors, and clinical outcomes of definite and 
suspected acute exacerbation cases suggest that suspected 
acute exacerbations may, in many cases, represent true 



acute exacerbation of IPF. Based on these observations, we 
believe that suspected acute exacerbations should be cap- 
tured and analyzed as a clinical trial endpoint. 

Very few definite acute exacerbations of IPF were 
identified in this study, consistent with recent clinical 
trial results [6-8]. We hypothesize that the adoption of 
strict criteria for acute exacerbation of IPF and logis- 
tical limitations in the clinical trial setting (e.g. diffi- 
culty obtaining clinical reports from outside hospitals, 
adjudicating cases based only on written reports) has 
resulted in the under-recognition of actual acute 
exacerbation events. The reclassification of 6 acute ex- 
acerbations from the original STEP-IPF trial as 
suspected acute exacerbations in this reanalysis using 
the current, stricter criteria for acute exacerbation il- 
lustrates this point. We believe these "missed" acute 
exacerbations are captured by the suspected acute ex- 
acerbation endpoint. Interestingly, combining definite 
and suspected acute exacerbations in this STEP-IPF 
re-analysis results in an incidence of 0.20 per patient 
year, similar to what has been described in a recent 
large epidemiological study [5]. This is unlikely to be 
the only reason for the low number of definite acute 
exacerbations identified in this and other clinical trials 
(e.g. improved clinical care for subjects enrolled in 
trials could contribute), but the possibility of a meth- 
odological contribution should be explored further in 
future clinical trials. 

Disease severity and ethnicity have been suggested as 
potential reasons for varying rates of acute exacerbation 
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■ Definite/Suspected AEX □ Other Acute Worsening □ No Acute Worsening 

Figure 3 Association of acute exacerbation and other acute worsenings with disease progression. Disease progression was variably 
defined by >10% relative decline in forced vital capacity (FVC), > 15% relative decline in diffusion capacity for carbon monoxide (DLCO), > 30 
meter decline in 6 minute walk distance (6MWD), > 5 point increase in the University of California San Diego (UCSD) shortness of breath 
questionnaire, and > 5 point increase in the St. George's Respiratory Questionnaire (SGRQ). 
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Table 2 24-week mortality by acute worsening status 



Group 


Number of deaths 


Number at risk 


24-week mortality 


Acute Exacerbation of IPF * 


8 


17 


47% 


Other Acute Worsening 


6 


13 


46% 


No Acute Worsening 


1 


150 


1% 



* Combined definite and suspected cases. Two deaths were in the definite acute exacerbation group (50% mortality rate at 24 weeks) and six deaths were in the 
suspected acute exacerbation group (46% mortality rate at 24 weeks). 
Abbreviations: IPF, idiopathic pulmonary fibrosis. 



in clinical trials [5]. In the current study, the finding that 
multiple measures of disease severity are associated with 
increased risk of definite and suspected acute exacerba- 
tion suggests that patients with earlier disease (i.e. those 
patients typically enrolled into clinical trials of novel 
drug agents) may have a lower incidence than the gen- 
eral population of IPF patients and the more advanced 
population enrolled into STEP-IPF. However, there are 
plausible explanations for why acute exacerbation ap- 
pears to occur more frequently in patients with ad- 
vanced disease that have nothing to do with the actual 
rate of events (e.g. decreased physiologic reserve in ad- 
vanced disease resulting in more clinical signs and 
symptoms, increased health care utilization in advanced 
disease resulting in a greater chance of clinical recogni- 
tion). Ethnic and racial differences in acute exacerbation 
risk may also exist, although data from recent clinical 
trials conducted in the United States, Europe and Japan 
using similar criteria for acute exacerbation adjudication 
do not support this hypothesis [6,7,11-13]. 

We believe a strong argument can be made for includ- 
ing both definite and suspected acute exacerbations 
as outcome measures in clinical trials. First, suspected 
acute exacerbations of IPF are clearly common, clinically 
important events. Second, our data support the hypoth- 
esis that many suspected acute exacerbations are indeed 




14 

Weeks after event 



Figure 4 Acute worsening and survival. Cases adjudicated as 
definite or suspected acute exacerbation (AEX) of IPF (solid line) and 
other acute worsening (dashed line) were associated with similar 
short-term risk of death. 



acute exacerbations. Third, in many clinical centers, 
HRCT scanning and respiratory cultures are not rou- 
tinely performed on IPF patients with idiopathic respira- 
tory worsening, as the tests are not felt to change 
clinical management (patients are simply treated empir- 
ically for both pneumonia and acute exacerbation), and 
involve cost and risk. These cases, therefore, cannot be 
classified as definite acute exacerbations. For all of these 
reasons, we believe that including suspected acute exac- 
erbations along with definite acute exacerbations as end- 
points in clinical trials will most appropriately capture 
the clinically meaningful events of interest to clinical 
trialists. Whether definite and suspected acute exacerba- 
tions should in fact be combined into a single endpoint 
in clinical trials remains unclear. 

The association of season with both definite and 
suspected acute exacerbation of IPF is notable, and sug- 
gests that there may be factors such as respiratory viral 
infection or air pollution (products of combustion, par- 
ticulate matter) that contribute to the pathogenesis of 
these events. This seasonal association has not been reli- 
ably demonstrated in retrospective cohort studies [5,14], 
and it has been difficult to demonstrate widespread evi- 
dence of infection in cohorts of carefully evaluated cases 
[5,15,16]. However, this finding is striking and suggests 
that seasonal risk factors may play a role in acute exacer- 
bation of IPF. 

Conclusion 

In summary, we report that suspected acute exacerba- 
tions of IPF are common in the clinical trial setting, are 
clinically indistinguishable from definite acute exacerba- 
tions, and are associated with a similarly high risk of dis- 
ease progression and short-term mortality. There should 
be no doubt that suspected acute exacerbation of IPF is 
a clinically important event in the lives of patients. We 
propose that those responsible for designing future clin- 
ical trials rethink the methodological approach to cap- 
turing acute exacerbation of IPF, and consider less 
restrictive criteria. Specifically, we propose recording 
both definite and suspected acute exacerbations of IPF, 
and analyzing them either as separate outcome measures 
or as a combined idiopathic acute worsening endpoint. 
Additional changes to the methodology of acute exacer- 
bation identification in clinical trials may also be 
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worthwhile (e.g. site-investigator-driven identification 
process vs. central adjudication), and studies comparing 
the appropriateness and feasibility of various approaches 
to defining and identifying acute exacerbation of IPF in 
clinical trials are greatly needed. 

Additional files 
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Additional file 1: Figure El. Study design for STEP-IPF. Patients were 
eligible for enrollment in STEP-IPF if they met consensus criteria for the 
diagnosis of IPF and had a diffusion capacity for carbon monoxide 
(DLCO) of less than 35% of the predicted value. Enrolled subjects were 
randomized to active drug (sildenafil 20 mg three times daily) or placebo 
for the first 12 weeks of the study, then given open label sildenafil for the 
second 12 weeks. 

Additional file 2: Table El. Diagnostic Criteria for Acute Exacerbation. 
Table E2. Reasons for "suspected acute exacerbation" diagnosis. 



